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(54) Discriminating between different types of image data 

(57) The processing means includes image content discrimination means 314,316,318,320,322 for 
discriminating whether the input image data from image sensor 301 represents a half-tone image, a line 
image or a combination thereof. Image data to be discriminated is divided into 8X8 pixel blocks, and the 
image type determined on the basis of the pixels, in the block, with maximum and minimum density. The 
block may be compared 326 with one of a plurality of dither matrices (Fig. 3) if the block represents on 
image area containing tonal values, or with a threshold (Fig. 3D) if the block represents a linear image area 
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SPECIFICATION 

Image processing apparatus 

5 BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image pro- 
cessing apparatus suitable to facsimile ma- 
chine, electronic file, reader or digital copying 
10 machine. 

Description of the Prior Art 

In a prior art half-tone image processing 
system, an image signal level of each pixel is 

15 compared with a predetermined threshold and 
if the former is higher, black is reproduced, 
and if the former is lower, white is repro- 
duced so that a pseudo-gray level is repro- 
duced (systematic dither method). However, 

20 since this method has a much lower resolution 
power than that of a simple binary recording 
method (fixed threshold binary recording), a 
quality of image which requires a high resolu- 
tion power such as a character area is low- 

25 ered. 

In order to resolve the above problem, in a 
method disclosed in Japanese Unexamined Pa- 
tent Publication No.3374/1983 an image is 
divided into a plurality of blocks and a half- 

30 tone image area such as a photograph area or 
a binary image area (line image area) such as 
a character area is discriminated by a differ- 
ence between maximum and minimum density 
levels of pixels in each block. This method is 

35 effective for the character or symbol area but 
when it is applied to a natural picture, the 
following problems are encountered. 

(A) If a half-tone image area is misjudged to 
be a binary image area, the area to be repre- 

40 sented by gray level is represented by white 
or black stripes because the half-tone area is 
processed by a single threshold. Accordingly, 
the image quality is remarkably degraded. 

(B) If the character/symbol area has white or 
45 black background and fine black or white char- 
acters, that is, if the area has a high contrast, 
the above method is relatively effective, but if 
the area has a gray level background and 
black characters, the gray level area adjacent 

50 to the characters is misjudged to be the bi- 
' nary image area and the black or white stripes 
appear as do in (A). Accordingly, the image 
quality is degraded. 

55 SUMMARY OF THE INVENTION 

It is an object of the present invention to 
eliminate the above-noted disadvantage pecu- 
liar to the prior art and to provide an image 
processing apparatus which reproduces a high 

60 quality of image. 

It is another object of the present invention, 
to provide an* image processing apparatus 
which reproduces an original image with a • 
high fidelity. 

65 It is other object of the present invention to 



provide an image processing apparatus having 
an image discrimination function. 

It is other object of the present invention to 
provide an image processing apparatus having 
70 a high processing speed. 

It is other object of the present invention to 
provide an image processing apparatus 
capable of reproducing a high quality of image 
with a simple construction. 
75 It is other object of the present invention to 
provide an image processing apparatus 
capable of reproducing a high quality of image 
for any original image. 

Other objects of the present invention will 
80 be apparent from the following description of 
the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 shows an image reader used in one 
85 embodiment of the present invention, 

Figs. 2(a) and 2(b) show density distribu- 
tions of image signals, 

Figs. 3(a) — 3(d) show four dither patterns. 
Fig. 4 is a block diagram of a first embodi- 
90 ment of the image processing apparatus, and 
Fig. 5 is a block diagram of a second em- 
bodiment of the image processing apparatus. 

DETAILED DESCRIPTION OF THE PREFERRED 
95 EMBODIMENTS 

Fig. 1 shows an input device used in an 
embodiment of the present invention. A docu- 
ment sheet mounted on a transparent docu- 
ment table 101 is illuminated by an illumina- 

100 tion system including a lamp 102 and a reflec- 
tion shade 103, and a reflected light is di- 
rected to a first mirror 104, thence to a lens 
system 107 through a second mirror 105 and 
a third mirror 106, and focused onto a sensor 

105 108 such as CCD. The sensor 108 is an array 
sensor which is electronically scanned in a 
main scan direction and mechanically scanned 
in a sub-scan direction. 

Figs. 2(a) and 2(b) show distributions of fre- 

110 quencies of appearance of blocks versus im- 
age densities when a portion of an original 
view is viewed through an n X n-pixel block 
window. Fig. 2(a) shows the frequency of 
appearance around characters. A po:nt A 

115 shows a density of background of the original 
image, and a point B shows a density of the 
character area. Fig. 2(b) shows a histogram 
around a half-tone image. A point C shows a 
mean density of the half-tone imcj*i>; 

120 In the prior art system, if the ; >n.« : jr<im of 
the image area to be discriminate. i r'x a dis- 
tribution as shown in Fig. 2(a), i- : ;,:rimi 
nated as a character/symbol ar- : ,; * •■ 
image area because an absolute . ; - r ' 

V//5 P : — P. is large, and if it has a * ' >>- os 
shown in Fig. 2(b), it is discrim:-- ■ 
,S )'J tone image area because >\ : 
v jl'je of P. — P 3 is small. 

However, depending on a si/ 

130 b'ock under consideration, th-.- . 
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does not suddenly change from the half-tone 
image area to the line image area but there 
must be an area in which both images are 
contained. In the prior art system, one of two 
5 image areas is selected at this point. As a 
result, the image quality is degraded. 

In the present embodiment, the binary im- 
age selection is not effected when the image 
area changes from the half-tone image area to 
10 the line image area but a dither pattern which 
is suitable to represent the half-tone is gradu- 
ally changed to a dither pattern which is suit- 
able to simple binary representation so that 
white or black stripes appeared in the prior art 
15 systems when the pattern is switched no lon- 
ger appear. This is attained by selecting the 
dither pattern in accordance with a difference 
between maximum and minimum image signals 
so that image processing appropriate for the 
20 image area is carried out. 

Figs. 3(a) — 3(d) show examples of dither 
patterns when an input image signal has 
0 — 255 tone levels. Figs. 3(a) shows a basic 
pattern (threshold matrix) having 65 tone 
25 levels (8 X 8 4- 1 - 65) and a resolution 
power of 1/8, Fig. 3(b) shows a basic pattern 
having 17 tone levels and a resolution power 
of 1/4, Fig. 3(c) shows a basic pattern having 
5 tone levels and a resolution power of 1/2, 
30 and Fig. 3(d) shows a basic pattern having 2 
tone levels and a resolution power of 1. For 
the same 8X8 pixels, the number of tone 
levels and the resolution power can be 
changed by the internal threshold array. 
35 Referring to Figs. 4 and 5, embodiments of 
the present image processing apparatus which 
uses the input device shown in Fig. 1 and 
selectively uses the patterns shown in Figs. 
3(a) — 3(d) to improve the image quality are 
40 explained. 

Fig. 4 shows a block diagram of the first 
embodiment of the. image processing appara- 
tus. Numeral 301 denotes an input sensor 
which corresponds to 108 in Fig. 1. An image 
45 signal is amplified by a video amplifier 302 in 
synchronism with a clock signal 307 sent 
from a sensor driver (not shown) and an ad- 
dress/ clock generator 306, and the output 
from the video amplifier 302 is supplied to an 
50 analog digital converter 303 where the analog 
pixel data is converted to a digital data. The 
digitized pixel data is supplied to line buffer 
memories 304 and 305 each having as many 
memory capacity as the number of pixels of 
55 the input sensor 301. The two line buffer 
memories are provided in order to allow con- 
current input to the line buffer memory and 
output from the line buffer memory. 

The image signal stored in the line buffer 
60 memory is transferred to a block memory 3 1 2 
in synchronism with a clock 311. The block 
memory 312 has a capacity of one lino ;n u 
main scan direction of the image signal .n the 
length thereof; and a width equal to a width 
65 in a sub-scan direction of a block under con- 



sideration. If the number of pixels in one line 
in the main scan direction is equal to M and 
the block under consideration has n X m pix- 
els, the necessary capacity of the block mem- 
70 ory is M X m pixels. For real time processing, 
2 X M X m pixels are required. 

The image signal 313 sequentially selected 
one pixel at a time from the block memory 
312 is compared with a dither threshold 323 
75 by a comparator 326, which produces a bi- 
nary image signal 327. In the following de- 
scription, it is assumed that the size of the 
pixel block under consideration is 4 X 4 pix- 
els, the number of pixels in one line of the 
80 sensor is 400 pixels, the size of the dither 

matrix is 8 X 8, and one pixel of image signal 
(A/D-converted image signal) is represented 
by 8 bits (— 1 byte). Under the above as- 
sumption, the number of blocks in one line is 
85 equal to 400 (pixels/line)/4 (pixels/block) = 
100 (blocks/line) Iwhen 100 blocks (4 lines) 
of image signal have been stored in the block 
memory 312, the subsequent image signal is 
stored in the remaining 100 blocks of memory 
90 area, and a maximum/minimum detector 314 
produces a signal for each block based on the 
100 blocks of image signal previously stored 
in the block memory 312. The maximum/mini- 
mum detector 314 also detects maximum and 
95 minimum densities of the pixels in each block 
and stores it in a memory in the maximum/- 
minimum detector 314. This memory has a- 
200-byte capacity to store, two pixels of the 
image signal for each block. The maximum/- 
100 minimum detector 314 may be comparator, 
flip-flop or memory. 

The minimum/maximum detector 314 stores 
the maximum and minimum densities for each 
block and also supplies them to a subtractor 
105 316. The subtractor 316 sends an absolute 
value 317 of a difference between the maxi- 
mum and minimum densities for each block, 
to a shift register 320 through an OR gate 
318 

110 The shift register 320 has a capacity of 10* 
bytes one for each block. Thus, the density 
differences of the 100 blocks previously 
stored are stored in the shift register 320. 
From the readout from the block memory 3 1 : 
115 to the storing of the density differences into 
the shift register 320, no synchronization will 
the block 307 of the sensor 301 is necessar 
and real time processing can be attained. 
A dither threshold memory 324 contains 
120 four patterns as shown in Figs. 3(a) — 3(d). In 
order to select one of the four patterns, two 
bits are required for a select input 321 (outp* 
of the shift register 320) of a selector 322. 
The shift register 320 appropriately compres: 
125 (quantamizes) the density differences stored 
therein (into two-bit codes in tho present em 
bodiment) to produce the select input 321. 

An X counter 330 and a Y counter 328 at 
used to address one thresho'd m the 8X8 
130 dither matrix. In the present ..-■"t;odiment, be 
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the X counter 330 and the Y counter 328 are 
of 3-bit configuration. Thus, the dither thresh- 
old memory 324 outputs four thresholds se- 
lected by the X counter 330 and the Y coun- 
5 ter 328. One of the four thresholds is se- 70 
lected by a selector 322 in accordance with 
the selector input 321 which represents the 
compressed density difference. The selected 
threshold must be the most appropriate one 

10 to the image area of the block. 75 
A comparator 326 compares the selected 
threshold 323 with the image signal of the 
pixel from the block memory 312 selected by 
the outputs 331 and 332 of the X counter 

15 330 and the Y counter 328 of the block. The 80 
clock 310 for the X counter 330 indicates the 
step in the X direction of the original image, 
and the clock 309 of the Y counter 328 is 
generated based on the clock in the Y direc- 

20 tion (for example, a clock sent to a drive 85 
source to move the sensor in the sub-scan 
direction). 

In this manner, the first one line of image 
signal in the first 100 blocks is binarized by 

25 the optimum threshold for the block. Since the 90 
output 320 of the shift register is fed back 
through the OR gate 318, the same selector 
output 321 is again used for the second line. 
Accordingly, in order to binarize 100 blocks 

30 (four lines) of pixels, four circulations in the 95 
shift register 320 are required. 

By the time when the first 100 blocks of 
pixels are binarized, the next 100 blocks (four 
lines) of pixels have been stored in the block 

35 memory 312. Thus, the next 100 blocks are 100 
processed in the same manner so that the 
image signals sent from the sensor 301 are 
successively binarized. 
Fig. 5 shows a second embodiment of the 

40 present invention. In the present embodiment, 105 
the image signal is compared with a plurality 
of dither patterns, and comparison results are 
stored and then one of them is selected in 
accordance with an image area discrimination 

45 result. Numerals 301 — 311 denote the same 110 
elements as those shown in Fig. 4. Like in the 
previous embodiment, it is assumed that one 
block has 4X4 pixels and one line has a 
length of 400 pixels. 

50 The output data from the line buffer mem- 1 15 
ory 304 or 305 is parallelly supplied to digital 
comparators 408, 412, 416 and 420 and an 
image area discriminator 424. Numerals 409, 

413, 417 and 421 denote memories which 

55 contain four patterns of Fig. 3, respectively. 120 
Signals 410, 414, 418 and 422 applied to 
the memories 409, 413, 417 and 421 are 
address signals generated by the addres- 
s/clock generator 306 and each of which con- 

60 tains three low order bits in the X direction 125 
and three low order bits in the Y direction of 
the position address of the original image. Ac- 
cordingly, each of the address signals 410, 

414, 418 and 422 selects one of 64 (- 8 
65 8) thresholds. The signals 410, 414, 418 and 



422 designate the same position in the four 
dither patterns at the same timing. 

Each pixel from the line buffer memory 304 
or 305 is compared by the respective thresh- 
olds by the comparators 408, 412, 416 and 
420, and the binarized comparison results are 
supplied to shift registers 411, 415, 419 and 
423, respectively, each having a capacity of 
400 bits X 4 lines to store 4 lines of binar- 
ized image signal. 

Numeral 424 denotes the image area dis- 
criminator which comprises the block memory 
312, maximum/minimum detector 314 and 
subtractor 316 shown in Fig. 4, numeral 425 
denotes a discrimination result memory which 
comprises the OR gate 318, shift register 320 
of Fig. 4 and a compressor for compressing 
the discrimination result. The above elements 
function in the same manner as the previous 
embodiment. 

An output 425 is a coded output (2-bit 
coded output in the present embodiment) of 
the image area discrimination results for 100 
blocks corresponding to four lines of image 
signal. The shift registers 411, 415, 419 and 

423 each stores four lines of image signal 
binarized in accordance with one of four dither 
patterns, and produces a binarized signal A1, 
A2, A3 or A4. The signal binarized by the 
most appropriate dither pattern to the block is 
selected by the selector 426 by the signals 
A1, A2, A3 and A4. Since the shift registers 
411, 415, 419 and 423 each has the four-line 
capacity, they are synchronized with the image 
area discriminator 424. 

Two embodiments of the present invention 
have been described. A common feature to 
the both embodiments is that a plurality of 
threshold patterns are selectively used in ac- 
cordance with the discrimination result for the 
image area while the prior art image area dis- 
crimination uses either a dither pattern or a 
single-threshold pattern. As a result, instead 
of the switching between the half-tone area 
and the line image area, several selection pat- 
terns are used between those two image 
areas. Thus, the abrupt pattern change is 
avoided and the degradation of the image 
quality due to the misdiscrimination of the im- 
age area is prevented. When the image area 
is definite, the advantage of the prior art sys- 
tem is also attained. In this manner, the over- 
all image quality is improved. 

In the above embodiments, the threshold 
matrix and comparators are used for binariza- 
tion process such as dither processing. Alter- 
natively, a memory such as ROM may be ad- 
dressed by the image data (or address data) 
so that it is binarized. In this case, the ROM 
outputs the binarized "1" and "0" data. 

The present invention is not limited to the 
hiubtrated embodiments but various modifica- 
tions can be made within a scope of the 
claims'. 
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CLAIMS 

1. An image processing apparatus compris- 
ing: 

image data input means; and 

5 processing means for processing an image 
data inputted by said image data input means, 
said processing means including image content 
discrimination means for discriminating 
whether the input image data represents a 

10 half-tone image, a line image or a combination 
thereof. 

2. An image processing apparatus according 
to Claim 1 wherein said discrimination means 
divides the input image data into a plurality of 

1 5 blocks and discriminates the image content for 
each of said blocks. 

3. An image-processing apparatus according 
to Claim 2 wherein said discrimination means 
discriminates the image content of each block 

20 on the basis of maximum and minimum image 
data in each block. 

4. An image processing apparatus according 
to Claim 1 further comprising binarization 
means for binarizing the input image data, said 

25 binarization means being capable of binarizing 
the image data in first, second 'and third pro- 
cessing modes by using first, second and 
third threshold matrices. 

5. An image processing apparatus according 
30 to Claim 4 wherein said discrimination means 

selects one of said first, second and third pro- 
cessing modes in accordance with the dis- 
crimination result. 

6. An image processing apparatus compris- 
35 ing: 

image data input means; and 

processing means for processing an image 
data inputted by said input means; 

said processing means including means for 
40 discriminating a content of the input image 
data and binarization means for binarizing the 
input image data, said binarization means be- 
ing capable of binarizing the image data in 
first, second and third processing modes by 
45 using first, second and third threshold ma- 
trices, said discrimination means selecting one 
of said first, second and third modes in accor- 
dance with the discrimination result. 

7. An image processing apparatus according 
50 to Claim 6 wherein said discrimination means 

discriminates whether the input image data 
represents a half-tone image, a line image or a 
combination thereof. 

8. An image processing apparatus according 
55 to Claim 6 wherein said discrimination means 

divides the input image data into a plurality of 
blocks and discriminates the image content for 
each of said blocks. 

9. An image processing apparatus according 
60 to Claim 8 wherein said discrimination mnans 

discriminates the image content of each :;!ock 
on the basis of maximum and minimum i-mar;e 
data in each block. 10. An image proc^o.ng 
apparatus substantially as herein described 
65 with reference to Fig. 4 of the accomp- -.jying 



drawings. 11 . An image processing apparatus 
substantially as herein described with refer- 
ence to Fig. 5 of the accompanying drawings. 
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